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(57) A self alignment autostereoscopic display sys- 
tem (2) comprises an image generator (2), an optically 
addressed spatial light modulator (OASLM) (20), an in- 
frared illumination system (12) and a refractive optical 
system (14). The image generator (2) generates a pair 
of orthogonally polarised images, the one image being 
vertically orientated with respect to its polarisation and 
the other image being horisontally orientated with re- 
spect to its polarisation. The images are transmitted 
from the image generator along respective optical paths 
towards the observers for the illumination of at least a 
left hand part and a right hand part including the left eye 
and the right eye, respectively, of the heads of the ob- 
servers. The optically addressed spatial light modulator 
(OASLM) (20) includes a plurality of light transmission 
elements, each being individually optically addressable, 
and each having an optical input and an optical output 
and being shiftable between a V-state and a H-state in 
which V-state the transmission of vertically polarised 
light from the optical input to the optical output is allowed 
and the transmission of horisontally polarised light from 
the input to the output is inhibited or blocked, and in 
which H-state the transmission of horisontally polarised 
light from the optical inputtothe optical output is allowed 
and the transmission of vertically polarised lightfromthe 
optical input to the optical output is inhibited or blocked. 
Each of the light transmission elements has an optical 
sensor for the shifting between the V- and H-states 
through exposure to light or infrared radiation (IR). The 
OASLM is positioned in the optical paths from the image 
generator to the observers. The infrared illumination 
system (IR) illuminate the observers for illumination of 
at least the left hand part or the right hand part of the 
head of each of the observers and in doing so , exposing 
a first part of the optical sensors of the plurality of light 
transmission elements of the OASLM to infrared radia- 



tion reflected from the left hand part or the right hand 
part of the head of the observers. The optical sensors 
of the first part shift their respective light transmission 
elements into allowing transmission of a first image of 
the pair of orthogonally polarised images and inhibiting 
or blocking for the transmission of the other or second 
image of the pair of orthogonal polarised images and 
the optical sensors not belonging to the first part shifting 
their respective light transmission elements into allow- 
ing transmission of the other or second image of the pair 
of orthogonally polarised images and inhibiting or block- 
ing for the transmission of the first image of the pair of 
orthogonal polarised images through the remaining light 
transmission elements. The refractive optical system 
(14) includes at least one refractive optical element po- 
sition in front of the OASLM between the OASLM and 
the observers for establishing the optical parts. 
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Description 

[0001] stereoscopic displays are based on present- 
ing one image to the riglit eye and another innage to the 
left eye, the images being two slightly shifted viewpoints 
of the same object or scene, a left eye view and a right 
eye view. 

[0002] In a conventional stereoscopic display system, 
an observer wears glasses for separating right and left 
images displayed, Autostereoscopic displays lets an ob- 
server observe stereoscopic images without the need 
to wear glasses. 

[0003] Autostereoscopic displays provides separate 
images for each eye by employing directional displays, 
transmitting or reflecting different viewpoint images in 
different directions, so that the right eye of an observer 
will observe one viewpoint image, the left eye another 
viewpoint image. From each pixel of such a display, the 
right eye will receive light of a specific intensity and a 
specific color composition and the left eye will receive 
light of a different intensity and a different color compo- 
sition. 

[0004] Directional displays have been made using 

mechanical parallax barriers and optical parallax barri- 
ers such as lenticular sheets, lens arrays and spatial 
light modulators. 

[0005] Autostereoscopic displays generally falls in 
two categories: multi parallax and dual parallax. 
[0006] Multi parallax displays employs a plurality of 
images taken from different viewpoints, and the display 
emits these images succesively in succesive directions, 
so that at any position within the viewing area, an ob- 
server will receive two images of shifted viewpoints with 
right and left eye respectively. Multi parallax displays 
have the advantage of look-around ability, an observer 
may move around an object, which will appear steady 
in space. Multi parallax images are complex to record 
or synthesize, and requires high bandwidth fortransmis- 
sion and requires very high resolution of the display to 
produce reasonable observed resolution. Examples of 
multiparallax displays are holograms and multi-parallax 
lenticular displays. 

[0007] Dual parallax displays use only two viewpoints. 
These do not provide for look-around capability, which 
is, however, in many applications not of a big concern. 
Images for dual parallax displays are easier produced 
and transmitted, and only require double the resolution 
of a display as compared to a monoscopic image of the 
same observed resolution. Some dual parallax material 
already exists, such as 3-D pictures, 3-D movies etc. 
Dual parallax autostereoscopic displays may further be 
divided into two categories: fixed barrier displays and 
observer tracking displays. 

[0008] Fixed barrier displays suffer from the draw- 
back, that they can only be viewed comfortably by one 
or a few observers from a limited number of locations, 
because the observers must align themselves with the 
fixed ban^iers, so the left and right eye are correctly re- 



ceiving the respective images, otherwise a "pseudo- 
scopic" image of reversed left and right images is ob- 
served. 

[0009] One kind of observer tracking displays over- 
5 come this by tracking the head position of the observers, 
and adapting the parallax barrier to the tracking infor- 
mation, Reference is made to US Patent 6,008,484 
which is hereby incoprorated in the present specification 
by reference. 

10 [0010] Another approach is to display alternating pat- 
terns based on a synthesized image calculated from an 
image captured of the observers with an infrared vlde- 
ocamera on a monochrome display, acting as back illu- 
mination of a transparent type LCD display panel with a 

15 large lens element disposed therein between, so that 
emitted light from the alternating patterns will emit in the 
directions of the observers left and right eyes alternat- 
ingly, synchronized with the left and right images being 
displayed on the led panel alternatingly, in a time-divi- 

20 sion manner Fig. 5 illustrates such an arrangement. 1 
denotes an observer, 2 denotes an infrared illumination 
source, 3 denotes an infrared tv camera, 4 denotes an 
image processing system, 5 denotes a monochrome 
display used as back illumination, 6 denotes a very large 

25 convex lens and 7 denotes a transparent color led dis- 
play. Fig. 6 illustrates captured and synthesized images. 
1 denotes an image of the observer captured in essen- 
tially frontal illumination, 2 denotes an image of the ob- 
server captured with illumination from the observer's 

30 right, 3 denotes a synthesized binary left half image and 
4 denotes a synthesized binary left half image. Refer- 
ence is made to US Patents 5,568,314 and 6,069,649, 
which are hereby incorporated in the present specifica- 
tion by reference. 

35 [0011] Such a system may provide a high degree of 
freedom for a number of simultaneous observers, but is 
limited in size, and hard to make slim, and further it is 
applicable only to a limited range of display types, there- 
fore not being able to take advantage of recent devel- 

40 opments in display technology, such as for example flat- 
screen plasma displays, 

[0012] An object of the invention is to overcome the 
above mentioned problems in prior art relating to either 
the need to wear glasses, to the complexity of producing 

45 and transmitting images, to the limitations in viewing an- 
gles and number of observers, to the ability to scale to 
big size displays and take advantage of a wide range of 
existing and evolving display technologies, includingflat 
panel systems and electronic projection systems. 

50 [0013] Another object of the invention is to produce 
an autosterescopic rear projection screen for operation 
with a projector, or a pair of projectors, capable of pro- 
jecting polarised, spatially or temporally multiplexed 
moving or still sterescopic image pairs, the projectors 

55 being of a wide range of types 

[0014] A third object of the invention is to produce an 
autosterescopic display overlay screen, which can be 
overlayed on a display capable of displaying polarised. 
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spatially or temporally multiplexed moving or still stere- 
scopic image pairs, the display being of a wide range of 
types. 

[0015] The above objects together with numerous 
other objects, advantages and features which will be ev- 
ident from the below detailed description of presently 
prefered embodiments of the autostereoscopic display 
system according to the present invention is obtained 
by an autostereoscopic display system, comprising: 

i) image generating means for the generation of a 
pair of orthogonally polarised images, the one im- 
age being vertically orientated with respect to its po- 
larisation and the other image being horisontally ori- 
entated with respect to its polarisation, said images 
being transmitted from said image generating 
means along respective optical paths towards one 
or more observers for the illumination of at least a 
left hand part and a right hand part including the left 
eye and the right eye, respectively, of the head or 
heads of said one or more observer, 
11) an optically addressed spatial light modulator 
(OASLM) including a plurality of light transmission 
elements, each being individualy optically address- 
able, and each having an optical input and an opti- 
cal output and being shiftable between a V-state 
and a H-state in which V-state the transmission of 
vertically polarised light from said optical input to 
said optical output is allowed and the transmission 
of horisontally polarised light from said input to said 
output is inhibited or blocked, and in which H-state 
the transmission of horisontally polarised light from 
said optical input to said optical output is allowed 
and the transmission of vertically polarised light 
from said optical input to said optical output is inhib- 
ited or blocked, each of said light transmission ele- 
ments having an optical sensor for the shifting be- 
tween said V-and H-states through exposure to light 
or, preferably, infrared radiation (IR), said OASLM 
being positioned in said optical paths from said im- 
age generating means to said one or more observ- 
ers, 

ill) an infrared illumination system for illuminating 
said one or more observers for illumination of at 
least the left hand part or the right hand part of the 
head of each of said one or more observers and in 
doing so, exposing a first part of said optical sensors 
of said plurality of light transmission elements of 
said OASLM to infrared radiation reflected from the 
left hand part or the right hand part of the head of 
each of said one or more observers, said optical 
sensors of said first part shifting their respective 
light transmission elements into allowing transmis- 
sion of a first image of said pair of orthogonally po- 
larised images and inhibiting or blocking for the 
transmission of the other or second image of said 
pair of orthogonal polarised images and said optical 
sensors not belonging to said first part shifting their 



respective lighttransmission elements into allowing 
transmission of the other or second image of said 
pair of orthogonally polarised images and inhibiting 
or blocking for the transmission of the first image of 

5 said pair of orthogonal polarised images through 
said remaining lighttransmission elements, and 
iv) a refractive optical system, including at least one 
refractive optical element position in front of said 
OASLM between said OASLM and said one or more 

10 observers for establishing said optical parts. 

[0016] According to the basic teachings according to 
the present invention , the optical controlling and shifting 
of the light transmitting elements of the OASLM allows 

15 for the utilisation of the OASLM technique for providing 
an optically self-aligning and self-adjusting autostereo- 
scopic 3-D display system, as the optically addressable 
and shiftable light transmitting elements of the OASLM 
may be addressed individually through the reflection of 

20 Infrared radiation from a half part of the heads of the 
observers or a single head of a single observer since, 
based on the teachings of the present invention, the re- 
transmission, so to say, of the reflected infrared radia- 
tion from the one half part of the head or the heads of 

25 the one observer or alternatively the observers, estab- 
lishes a specific addressing of those light transmitting 
elements positioned in the intentional lighttransmission 
path from the one image generating means to be used 
for illuminating the one eye of the observer or the ob- 

30 servers of the half part of the observer or of the heads 
of the observers, which half part is exposed to the IR 
illumination. 

[0017] The at least one refractive optical element po- 
sitioned or located in front of the OASLM between the 

35 OASLM and the observer or the observers or alterna- 
tively or preferably located juxtaposed in front of the 
OASLM provide directivity to light transmitted through 
the OASLM and provide focusing of the refractive light 
or the infrared radiation from the observer or the observ- 

40 ers on to the OASLM. 

[0018] In the presently preferred embodiment of the 
autostereoscopic display system according to the 
present invention, the at least one refractive optical el- 
ement including a lens system, inlcuding at least one 

45 circular or cylindrical lens and/or including a multitude 
of refractive optical elements. 
[0019] The OASLM is continously updated by pat- 
terns of reflections of the infrared illumination of the ob- 
servers' faces, which are projected onto the OASLM, 6'\- 

50 rectly ors acting as "write-light", forming regions or "do- 
mains" of the OASLM , and the OASLM is capable of per- 
forming an at least essentially binary modulation in 
these domains, of the transmitted, visible "read-light" 
from the image generating means controlled by a 

55 thresholding function determining whether the received 
lights characteristics are mostly alike the right observer 
illumination's or the left observer illumination's charac- 
teristics, so that the transmitted, modulated visible light 
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travel back the same path through the optical element, 
as the incident infrared light, that controlled it's modula- 
tion , towards the face of the observer or the faces of the 
observers. 

[0020] According to alternative embodiments of the 
autostereoscopic display system according to the 
present invention, the OASLM being a structure includ- 
ing a plurality of discrete OASLM elements or alterna- 
tively being a continuous structure. 
[0021] According to a preferred and advantageous 
embodiment of the autostereoscopic display system ac- 
cording to the present invention, the image generating 
means is controlled by a clock generator generating a 
blanking period in which the image generating means 
are turned off, the optical sensors of the OASLM are 
controlled by the clock and preferably enabled during 
the blanking period and disabled outside the blanking 
period, so that no shifting of the state of the light trans- 
mission elements may occur outside the blanking peri- 
od, and the infrared Illumination system is preferably 
controlled by the clock and turned on during the blanking 
period 

[0022] The OASLM may, according to alternative em- 
bodiments of the autostereoscopic display system ac- 
cording to the present invention, the image generating 
means being constituted by a CRT (cathode ray tube)- 
an LCD (liquid crystal display)- a DLP (digital light 
processing) projector, a film or slide projector or alter- 
natively a CRT-, an LCD- or plasma display. 
[0023] In a prefen^ed and advantageous embodiment 
of the autostereoscopic display system according to the 
present invention, the OASLM is located in front of a dis- 
play capable of displaying a spatially modulated stere- 
oscopic image pair, and the system further comprises a 
patterned polarizer with a pattern of areas of essentially 
orthogonal polarisation direction, located between the 
display and the OASLM, so that display pixels relating 
to a first image of the stereoscopic image pair are cov- 
ered by areas of afirst polarisation direction, and display 
pixels relating to a second image of the stereoscopic im- 
age pair are covered by areas of a second polarisation 
direction. 

[0024] Optionally, a spacer may be provided, estab- 
lishing a distance or spacing between the polariser and 
the OASLM. The spacer may be made from glass. 
[0025] The pattern of the polariser may be a striped 
pattern. 

[0026] Alternatively, the pattern of the polariser may 
be a checker-board pattern. 

[0027] Further alternatively, the pattern of the polaris- 
er is of a different shape, adapted to the display. 
[0028] Further alternatively, the OASLM is located in 
front of a display capable of displaying a time-division 
based stereoscopic image pair, and comprises a polar- 
izer, located in front of the display, and a liquid crystal 
cell, capable of rotating the polarisation direction of 
transmitted light, located between the polarizer and the 
OASLM. 



[0029] The above described at least one refractive op- 
tical system may, as pointed out above, comprise circu- 
lar lenses, such as a micro lens array sheet. 
[0030] Further alternatively, the layer of optical ele- 
5 ments comprises cylindrical lenss, for example being a 
lenticular sheet. 

[0031] In a particular advantageous embodiment of 
the display system according to the invention, a spacing 
element is included in a liquid crystal layer of the OASLM 
10 in the form of a film or plate with punched, etched or 
othen/vise produced holes, the holes located so they are 
aligned with the centers of the optical elements of the 
optical layer, the holes being cylindrical or of any other 
shape. 

15 [0032] In the preferred embodiment of the display sys- 
tem according to the invention, the left and right illumi- 
nations are differentiated simply by the presence or the 
absence of illumination, in other words one half part of 
the face or faces is infrared illuminated, theother oroth- 

20 ers are not. The thresholding function of the OASLM lay- 
er is thus an intensity thresholding, which most types of 
available OASLM's are capable of perfomning. 
[0033] In an alternative embodiment of the display 
system according to the invention, the left and right illu- 

25 minations are differentiated by having different peak 
wavelength. The thresholding function of the OASLM 
may in this case be based upon the intensity of light of 
a first wavelength subtracted the intensity of light of a 
second wavelength, such that for example reflections 

30 from the left illumination tends to pull a domain below 
the threshold, and reflections from the right illumination 
tends to pull a domain above the threshold. A wave- 
length sensitive asynchronous image subtracting 
OASLM has been demonstrated by Moddel et al., "Ma- 

35 terials Research Society Symposium Proceedings", 
Volume 297, 1993. 

[0034] In another alternative embodiment of the dis- 
play system according to the invention, the two illumi- 
nations are differentiated by having different temporal 

40 modulation, for example square wave modulations hav- 
ing the same frequency but reversed phases, i.e. the left 
half part and the right half part are illuminated alternate- 
ly, for example at a rate of 1000 Hz. In this example, a 
synchronous image subtracting OASLM may be used. 

45 Reference is made toobinson Optics Letters 15. jun 92. 
[0035] One or more of these differentiation and 
thresholding techniques may be combined, to optimize 
differentiation and thresholding. 
[0036] To reduce the unwanted interfering effect of 

50 light not originating from the illumination system acting 
as write-light on the OASLM , the following alternative or 
complementary interference reducing means may be 
provided: 

[0037] The interference reducing means include the 
55 photodiode substrates being selected so as to reduce 
the sensitivity to visible light relative to the sensitivity to 
infrared light. 

[0038] The interference reducing means include that 
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ambient lighting is kept relatively low. 
[0039] The interference reducing means include a 
display having blanking intervals, and an operating cy- 
cle of the OASLM is incorporated, so that the OASLM 
is essentially only sensitive to write-light during the dis- 
plays' blanking period. This requires that the OASLM 
has a memory effect, so that the modulation pattern is 
maintained between the blanking intervals. 
[0040] This memory effect is achieved using a twisted 
nematic liquid crystal OASLM and including a rectifying 
diode in the circuit, so that when the polarity of the op- 
erating voltage is negative, the diode is reverse biased, 
exhibiting a high impedance towards the liquid crystal 
layer, the discharge time due to the layers' internal RC 
time constant and the relaxation time of the liquid crystal 
molecules of domains in the "on" state, essentially caus- 
ing the OASLM to maintain it's modulation pattern fixed 
in a short interval after the voltage was removed. 
[0041 ] Alternatively, the memory effect is achieved by 
using bistable ferroelectric liquid crystals In the OASLM. 
[0042] Further alternatively, the interference reducing 
means include a layer acting as a light valve, alternating 
between transparent and opaque, and synchronized 
with the operation cycle of the OASLM , The transparent 
and opaque intervals may be of different duration. The 
light valve may be a liquid crystal light valve. 
[0043] Still further, the interference reducing means 
include the use of an OASLM comprising a patterned 
shading layer, making it essentially only sensitive to 
write-light incident from the front, thus insensitive to 
transmitted read-light from the back. Reference is made 
to US Patents 4,538,884 and 4,941 ,735, which are here- 
by incorporated in the present specification by refer- 
ence, 

[0044] The interference reducing means may further 
or alternatively include infrared blocking filter or filters, 
located in front of the image generating means. 
[0045] Alternatively, the interference reducing means 
include a layer of infrared blocking filter included in the 
screen, located behind the electro-optical layer, or in 
front thereof. 

[0046] Alternatively or additionally the interference 
reducing means may include theOASLM being an asyn- 
chronous image subtracting OASLM, selectively up- 
dateable by write-light of different peak wavelengths. 
[0047] In the alternative, the interference reducing 
means may include the OASLM being a synchronous or 
integrating, image subtracting OASLM, and operated so 
that any constant incident light is cancelled by alternat- 
ing positive and negative update cycles. 
[0048] In the following some alternative illumination 
systems are described. It is assumed, that the observ- 
er's face is directed towards the screen. 
[0049] According to the teachings of the invention, a 
pair of essentially point-like light sources is provided, 
one located to the left and the other located to the right 
of a group of one or more observers located inbetween 
the light sources, illuminating the observer or observers 



from both sides, thereby illuminating the left half part 
with a left illumination and the right half part with a right 
illumination. 

[0050] Alternatively, a pair of elongated, directional 
5 light sources is provided and located on both sides of 
the observers, for example located along the walls, illu- 
minating the observers from the sides, thereby illumi- 
nating the left half part with a left illumination and the 
right half side part with a right illumination. 
10 [0051] Further alternatively, several pairs of light 
sources are used, each located with one light source to 
the left of each observer or subgroup of observers and 
the other to the right of the observer or subgroup of ob- 
servers. 

15 [0052] Either the left or the right illumination sources 
of the above mentioned illumination systems may be 
eliminated, for illuminating only one half part of the face 
of the observer or the faces of the observers. 
[0053] The illumination system may comprise one es- 

20 sentially point-like illumination source placed to the right 
of one or more observers, illuminating the observers 
from the right, thereby illuminating only the right half part 
of the face of the observers. 

[0054] The light sources may, irrespective of its form 
25 comprise infrared LED arrays or infrared filtered halo- 
gen lamps, and they may be unfocused, focused or di- 
rectional. They may be located close to or far from the 
obsevers, for example but not limited to: on the screen 
itself, in a sitting chair, on the walls, on the ceilings or 
30 on the back of one or more auditorium chairs in front of 
the observers. 

[0055] Alternatively, one or more adaptive illumination 
systems may be provided, each comprising one or two 
infrared imaging projectors, located in front of the ob- 

35 servers, for example on the screen itself, and an observ- 
er tracking system, which may also be located on the 
screen . The observertracking system tracks the observ- 
ers' head positions and produce one or more images, 
which are projected by the infrared imaging projectors 

40 onto the observers, so that the light incident on the ob- 
servers' left half part face has a first set of characteristics 
and the light incident on the observers' right half part 
face has a second set of characteristics, different from 
the first set of characteristics. 

45 [0056] The observertracking information may be fed 
to an image processing system, which synthesises a bi- 
nary image, in turn modulating the infrared imaging pro- 
jectors, the binary image having a form, so that the pro- 
jected images illuminate the left half side of the observ- 

50 ers' faces with infrared light having a first set of charac- 
teristics and the right half side of the observers' faces 
with infrared light having a second set of characteristics, 
different from the first set of characteristics. 
[0057] The illumination systems each comprise one 

55 infrared imaging projector, which projects the binary im- 
age, so that one half side of the observers' faces are 
illuminated with a high intensity and the other half side 
of the observers' faces are illuminated with a low inten- 



5 



9 



EP 1 245 990 A1 



10 



sity. 

[0058] Alternatively, the illumination systems com- 
prise two infrared imaging projectors whicin are alter- 
nately blanked, the first imaging projector projecting the 
binary image, so that the left half side of the observers' 
faces are illuminated with a high intensity and the right 
half side of the observers' faces are illuminated with a 
low intensity, the other projecting an intensity inversed 
version of the binary image, so that the left half side of 
the observers' faces are illuminated with a low intensity 
and the right half side of the observers' faces are illumi- 
nated with a high intensity, hence, the left half side and 
the right half side of the observers' faces are illuminated 
with high and low intensities alternately. 
[0059] Further alternatively, the illumination systems 
each comprise one infrared imaging projector, which al- 
ternately projects a normal and an inversed version of 
the binary image, so the left half side and the right half 
side of the observers' faces are illuminated with high and 
low intensities of infrared light alternately. 
[0060] The above mentioned imaging projector may 
comprise an optical system, a binary operated spatial 
light modulator, electrically, optically or otherwise ad- 
dressed, and two infrared light sources, emitting infrared 
polarised light with essentially orthogonal polarisation 
directions, the two infrared light sources being illuminat- 
ed alternately, thereby projecting normal and reversed 
images of the image on the spatial light modulator. 
[0061] The observer tracking systems may further 
comprise an infrared camera for producing an infrared 
picture of the observers, for an image processing sys- 
tem to perform the observer tracking. Observer tracking 
comprising the use of image processing is well known 
in this and other arts. Reference is made to US Patents 
6,069,649 which US Patent is further hereby incorporat- 
ed in the present specification by reference. 
[0062] The infrared camera of an observer tracking 
system may be sensitive to light of a second wave- 
length, different from the wavelength of the illumination 
systems, and of which the OASLM is insensitive. The 
camera may incorporate it's own infrared illumination 
source, selectively illuminating at this second wave- 
length. A filter layer may be included in the OASLM to 
exclude infrared light of second wavelength. 
[0063] Alternatively, the infrared camera uses light at 
the same wavelength as the illumination systems, and 
may incorporate it's own pulsed or temporally modulat- 
ed infrared illumination source, synchronized with an 
operating cycle of the OASLM, so as not to interfere with 
the desired function of the OASLM by acting as write- 
light. The camera's illumination source may be in it's 
light emitting state only during a dedicated time slot dur- 
ing the projector's blanking interval, or it may be in it's 
light emitting state only outside of the projector's blank- 
ing interval. 

[0064] Further alternatively, the observer tracking 
camera uses the light of the nonnal and inversed ver- 
sions of the binary image, alternately projected by the 



illumination systems' infrared imaging projectors. 
[0065] The infrared camera's shutter may be open 
during two or more succesive alternations, performing 
a light integration resulting in an image of the observers 
5 illuminated by both binary infrared projected images 
thus essentially evenly illuminated, suitable for image 
processing. 

[0066] Alternatively, the infrared cameras' shutter 
function may be synchronized with the phase of the al- 

10 ternation, so that the camera is capable of both captur- 
ing infrared images of the observers when illuminated 
by the normal binary image and when illuminated by the 
reversed binary image. A first captured infrared image 
of the observers when illuminated by the normal binary 

15 image and a second succedingly captured infrared im- 
age of the observers when illuminated by the inversed 
binary image may be combined by an image processing 
system to a differential image, each resulting pixel value 
given by the absolute value of the difference between 

20 the corresponding pixel values of the first captured im- 
age and the second captured image. Given a fast 
enough alternation rate between the normal and in- 
versed binary projected images, the observers can be 
assumed not to move inbetween images, thus the dif- 

25 ferential image will be an evenly illuminated image of 
the observers, suitable for image processing. 
[0067] Further, the first and second captured infrared 
image may be compared with the synthesized binary im- 
age by an image processing system for detection and 

30 correction or compensation of any alignment errors be- 
tween the infrared camera and the infrared imaging pro- 
jectors. 

[0068] Corrections may be done either automatically 

or semi-automatically with the assistance of an operator, 

35 either physically, adjusting the camera's or projectors' 
position and directions or electronically. 
[0069] Compensation may be performed automatical- 
ly, having the image processing system maintaining pa- 
rameters for the geometric transformation between cap- 

40 tured and projected images. 

[0070] An alternative application of the invention 
when incorporating observer tracking, is to display the 
same image to both eyes of the observers, but letting 
two different groups of observers observe two different 

^5 images, based on some observer selection schedule. 
[0071] Another alternative application of the invention 
when incorporating observer tracking, is to display one 
same image to both eyes of all observers and another 
image, which may be a blank image, to any recording 

50 device present, such as a camera. 

DESCRIPTION OF THE DRAWINGS 



[0072] 

FIG. 1 is a plane view of the presently preferred ex- 
emplary embodiment of an autostereoscopic dis- 
play element according to the present invention. 
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FIG. 2A is a plan view of tlie optically addressed 
spatial light modulator of the presently preferred ex- 
emplary embodiment of the autostereoscopic dis- 
play element according to the present invention. 

5 

FIG. 2 B is a front view of the optically addressed 
spatial light modulator of the presently preferred ex- 
emplary embodiment of the autostereoscopic dis- 
play element according to the present invention. 

10 

FIG. 3 is a schematic diagram of the electrical con- 
nections of the presently preferred exemplary em- 
bodiment of the autostereoscopic display element 
according to the present invention. 

15 

FIG. 4 is a plan view of an example of a prior art 

autostereoscopic system. 

FIG. 5 shows captured and synthesized images by 
an image processing based observer tracking sys- 20 
tern. 

FIG. 6 A is a perspective view of a first alternative 

embodiment of the autostereoscopic display ele- 
ment according to the present invention. 25 

FIG. 6B is a top view of the arrangement shown in 
FIG. 7. 

FIG. 7 is a perspective view of a second alternative 30 

embodiment of the autostereoscopic display ele- 
ment according to the present invention. 

FIG. 8 is a plan view of a stripe patterned polarizer. 

35 

FIG. 9 is a cross section of an example of a standard 
reflecting OASLM. 

FIG. 1 0 is a cross section of the OASLM used in the 
first and second alternative embodiment of the 40 

autostereoscopic display element according to the 
present invention. 

FIG. 1 1 is a perspective view of a spacing element 
comprised by the liquid crystal layer of a first em- ^5 
bodiment for maintaining an accurate spacing in 
large size screens. 

FIG. 12 is a atop view of the illumination system of 
a second alternative embodiment. 5C? 

FIG. 13 is a top view of an alternative illumination 
system as compared to the system shown in Fig. 12. 

FIG. 14 is an example of an operating cycle. 55 

FIG. 15 is an example of an operating cycle of the 
presently preferred exemplary embodiment of the 



autostereoscopic display element according to the 
present invention. 

[0073] Figure 1 is an overall, plane view of an arrange- 
ment according to a presently preferred exemplary pro- 
totype embodiment of an autostereoscopic display ele- 
ment. This embodiment includes a display overlay 
screen comprising one single screen element, i.e. a low 
resolution version of the invention yet qualitatively sim- 
ilarto higher resolution versions, and a display including 
two pixels, i.e. a low resolution display yet qualitatively 
similar to higher resolution displays. The "images" con- 
stituting the stereoscopic image pair include one pixel 
each. 

[0074] The arrangement allows a single observer or 
several observers to observe the pixel as having one 

color when watched with the left eye and another color 
when watched with the right eye, even when moving to 
a different position, without ever seeing a "pseudoscop- 
ic" image of reversed pixel colors, from any position. 
[0075] A display 2 comprises two pixels, a left pixel 
1 6L, showing a left "image", and a right pixel 1 6R, show- 
ing a right "image". The pixels consist of light emitting 
diodes, selected so that the left pixel 1 6L emits blue light 
and the right pixel 1 6R emits red light. The pixel values 
are thus "hard-wired" in this arrangement. The display 
has an operating cycle alternating between bright and 
blanking intervals, both pixels being switched off to a 
dark state in the blanking interval. 
[0076] In front of the left pixel 1 6L a polarizer 1 8L of 
horisontal direction is located and in front of the pixel 
16R a polarizer 18R of vertical polarisation direction is 
located. Thus horisontally polarized blue light from the 
pixel 1 6L and vertically polarized red light from the pixel 
16R radiate towards a display overlay screen 1 , includ- 
ing a liquid crystal optically addressed spatial light mod- 
ulator (OASLM) 20. 

[0077] The OASLM 20 includes seven discrete mod- 
ulation segments, each being setable in a V-state or a 
H-state for the transmission of vertically polarised light 
or horisontally polarised light, respectively. The OASLM 
20 has an operating cycle synchronised with the display 
20. During the display 2's bhght interval, the OASLM 20 
is synchronised to transmit either vertically or horison- 
tally polarised light from the pixels 16Land 1 6R depend- 
ing on the setting of the individual segments of the 
OASLM 20, as the individual segment of the OASLM 20 
transmits, during the display 2's bright interval, vertically 
polarised light provided the segment in question be set 
in the V-state or alternatively transmits horisontally po- 
larised light provided the segment in question be set in 
the H-state. The setting of the individual segments of 
the OASLM 20 is performed during the blanking interval 
of the display 20 by means of incident light. The light 
being vertically polarised or alternatively horisontally po- 
larised lighttransmitted through the individual segments 
of the OASLM is referred to as 'read'-light, whereas the 
light incident to the individual segments of the OASLM 
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during the blanking interval for performing the setting in 
the V-state or alternatively the H-state of each of the 
segnnents of the OASLM is called 'write'-light. The set- 
ting of the individual segnnents of the OASLIVI performed 
during the blanking period of the display 20 is so to say 
stored by the OASLM 20 for the next bright interval for 
performing the transmission through the individual seg- 
ments in accordance with the polarisation of the individ- 
ual segments in the V-state or alternatively in the in- 
state, 

[0078] In the absence of write-light, all segments of 
the OASLM 20 will be in their V-state, and the OASLM 
20 will be transparent only to vertically polarized light, 
therefore only red lightfrom pixel 16R will be transmitted 
through the OASLM 20. Provided all segments of the 
OASLM 20 be exposed to write-light, the segments will 
all be in the H-state and the OASLM 20 will be transpar- 
ent only to horisontally polarised light, therefore only 
blue light from the pixel 1 6L will be transmitted through 
the OASLM 20. 

[0079] A convex lens 14 is located in front of the 
OASLM, projecting an image of the surface of the 
OASLM towards an observer 12, located in front of the 

screen. 

[0080] With each eye, the observer will observe a re- 
gion of the surface of the OASLM, thus in the absence 

of write-light, the lens 14 will appear red to both eyes of 
the observer. 

[0081 ] The observer 1 0 is now constantly illuminated 
by a left side face illumination from the left by a light bulb 
12 in front of which is located an infrared transmitting 
filter 13. so that the left half side of the observer's face 
is illuminated by infrared light or radiation. 
[0082] Infrared reflections off the left side illuminated 
face of the observer is radiated towards the screen and 
through the lens 14 project an Infrared Image of the ob- 
server's illuminated left half face, on the OASLM 20. 
[0083] Each segment of the OASLM 20 includes an 
infrared light sensitive element, which alters the state of 
the segment to the H-state, when influenced by infrared 
light reflected from the observer's left half face. There- 
fore, one or more segment(s) covered by the projected 
infrared image of the observers left half face will change 
to it's H-state and become transparent to the horisontal- 
ly polarized blue light from pixel 1 6L. The blue light will 
travel back towards the observer's left half side face, 
along the same optical path as the incident reflected in- 
frared light or write-light that formed a projection of the 
left half face of the observer on the OASLM 20. Segment 
(s) in the dark or right half part of the projected face will 
remain unaffected, red light will still radiate towards the 
observer's right half face. 

[0084] Thus, in the presence of a left side face illumi- 
nation, the lens 14 appears blue to the observer's left 
eye and red to the observer's right eye. 
[0085] This will remain true, even if the observer 
moves, as the infrared reflections will be incident upon 
another segment. 



[0086] Provided the observer alternatively is illuminat- 
ed from the right, the right eye will see the pixel as being 
blue and the left eye will see the pixel as being red. 
[0087] Provided a plurality of autostereoscopic dis- 
5 play elements are constructed and positioned side by 
side forming a pattern of pixels and screen elements, a 
higher resolution display fulfilling the object of the inven- 
tion is realized. 

[0088] Fig. 2 A an d2B are top and front views, respec- 

10 tively, of the OASLM 20 employed in the embodiment 
shown in Fig. 1 and constitutes a twisted nematic liquid 
crystal cell comprising liquid crystal elements contained 
within two glassplates. The one glassplate is coated on 
the inside with transparent conduction oxide electrodes 

15 28, forming discrete segments each connected to a re- 
spective external terminal. The other glassplate is coat- 
ed with transparent conductive oxide forming a common 
electode, connected to ground. On the front of the liquid 
crystal cell a polarising analyzer 24 of horisontal polar- 

20 isational direction is located. On the back of the liquid 
crystal cell 22 infrared sensitive photodiodes 26 are lo- 
cated. Each photodiode has it's anode connected to the 
respective external terminal of the transparent conduc- 
tive electrode positioned in front of it. The cathodes of 

25 all the photodiodes are connected to a common terminal 
29 of the OASLM. 

[0089] Fig. 3 is a schematic diagram of the connec- 
tions in the arrangement. A square wave oscillator 32 is 
connected to the light emitting diodes of the two pixels 
30 16L and 1 6R through a resistor 36, so that the diodes 
will only emit light during the oscillator's negative half 
wave periods. The oscillator is further connected to the 
common tenninal of the OASLM 20 through a rectifying 
diode 34. 

35 [0090] During positive half waves, the pixels are 
blanked and a positive voltage Is applied to the OASLM 
20's terminal 29; the photodiodes are biased in the re- 
verse direction, and the voltage across the electrodes 
of each segment of the liquid crystal cell will depend on 

40 the impedance of the photodiodes 26, and hence of the 
light incident upon them. In effect, each photodiode and 
liquid crystal segment together constitutes a voltage di- 
vider, the voltage across the electrodes depending on 
the impedance match between the photodiode and the 

45 liquid crystals. 

[0091] When in dark, the voltage across the elec- 
trodes of a segment are below the threshold of the so- 
called Freedericks transition, and the liquid crystal mol- 
ecules are in their relaxation state, causing the polari- 

50 sational direction of transmitted light to be approximate- 
ly 90 degress. In this state, only light of vertical polari- 
sational direction will be transmitted through the seg- 
ment and analyzer arrangement, since the analyzer only 
transmits light of horisontal polarisation. 

55 [0092] When infrared light of sufficient intensity is in- 
cident upon a photodiode from the front, it's impedance 
falls and the voltage across the segment in front of it 
raises to above the threshold of the Freedericks transi- 
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tion, the segment's liquid crystal molecules begin a tran- 
sition, and after a transition time, which is shorter than 
the half wave period, the segment shifts from it's V-state 
to it's H-state. Consequently, by the end of the half wave 
period, the polarisational direction of the segment be- 
comes approximately 0 degrees, thereby allowing only 
transmission of horisontal polarisation direction. 
[0093] During a succesive positive half wave, the rec- 
tifying diode 34 will become biased in the reverse direc- 
tion and the common terminal of the OASLM will be in 
a high impedance state. The segment's liquid crystal 
molecules will start a transition back to their relaxed 
state. 

[0094] However, the relaxation time is substantially 
longer than the transition time from V-state to H-state. 
Consequently, it is possible to adjust the frequency of 
the square wave oscillator, so that a full transition from 
V-state to H-state can occurduring a negative half wave, 
but very little change happens during the positive half 
wave, effectively maintaining the modulation pattern of 
the OASLM until the next negative half wave, during 
which the segments are again updated. If the write-light 
of a segment is removed, the segment will after several 
square wave periods eventually relax into it's V-state 
again. 

[0095] Hence, utilizing this phenomenon, a memory 

effect is achieved, which makes it possible to operate 
the OASLM 20 in a desired cycle of alternate "update" 
and "hold" intervals, preventing the OASLM 20 from be- 
ing unintentionally updated by light from the pixels. This 
operating cycle is illustrated in fig. 15. Since commer- 
cially available infrared sensitive elements normally also 
have some sensitivity to visible light, the above de- 
scribed operational mode is. Another approach would 
be to cover the photodiodes completely from the display 
by a shading layer or by covering them by Infrared filters, 
but this may not be practical or in some applications not 
possible. 

[0096] The frequency of the square wave oscillator in 
the above described prototype embodiment was adjust- 
ed to approximately 5000 Hz, which produced the de- 
sired memory effect. 

[0097] The pixel pair and screen element in the pro- 
totype embodiment is shielded by an enclosure, so light 
from other sources may not enter the arrangement and 
exit through the lens 14 towards the observer, influenc- 
ing the observed color of the screen element. In ar- 
rangements with more pixels and screen elements for 
higher resolution displays, such shielding arrangements 
may be comprised to exclude light from neighbouring 
pixels, ensuring a clear and sharp image, or the display 
could be located close enough to the overlay screen to 
obtain proximity focusing. 

Alternatively, one or more optical elements may be in- 
cluded to focus the light from the pixels onto the screen 
elements. These optical elements may be located be- 
hind the polarisers, so as not to change the light polar- 
isation characteristics obtained by these. 



[0098] A liquid crystall cell may rotate the polarisation- 
al direction of transmitted light differently dependent on 
the wavelength, which may cause pixel hue change and 
crosstalk between "images". Possible counteractions, 

5 including the insertion of an extra liquid crystal cell in 
the optical path, are well known, vide e.g. "Liquid Crys- 
tals", Peter J, Collins, Princeton University Press, New 
Jersey 1990, page 108. In the present prototype embod- 
iment this problem turned out to be insignificant, how- 

10 ever. 

[0099] In the prototype embodiment, the OASLM 20 
is charactehzed by being segmented and of low spatial 
resolution. By using an unsegmented OASLM or a seg- 
mented OASLM with higher resolution and preferrably 
15 a smaller spacing between segments, a higher degree 
of freedom of movement for the observer may be at- 
tained. 

[01 00] The photosensitive elements of the segments 
are not themselves transparent, but they are significant- 

20 ly smaller than the segments, and because a relatively 
large region around the observer's pupil, in fact half of 
the face, is illuminated, this presents no problem, unless 
the obsen/er is positioned exactly so that the photosen- 
sitive elements blocks the path of transmitted light to- 

25 wards one or both of her eyes. To overcome this prob- 
lem, the lens 14 may simply be adjusted a little out of 
focus, a diffusing layer incorporated in front of the 
OASLM or the lens may be made to blur the image 
slightly vertically only, in which direction less resolution 

30 is required. It is noted, that the adjustment of the focus 
of the lens has nothing to do with the observation of the 
(one-pixel) "image" as appearing in focus. The focus of 
the lens only relates to the precision and intensity 
thresholding in the mapping of read-light and write-light 

35 between the OASLM surface and the observer's face. 
[0101] Fig. 6A and 6B illustrates a first alternative em- 
bodiment of the autostereoscopic display element ac- 
cording to the present invention. In this embodiment, the 
single screen element of the above described arrange- 

40 ment is scaled to a rear projection screen 1 ' with a plu- 
rality of screen elements, allowing observers in front of 
the screen to observe a rear projected stereo image pair. 
[0102] A large transparent OASLM 20' comprising a 
diffusing layer designed for rear projection, is located 

^5 behind a microlens array 1 4', here shown with exagger- 
ated lens size and spacing for clarity. A pair 70 of gen- 
locked videprojectors project an image pair comprising 
a first horisontally polarized image and a second verti- 
cally polarized image onto the OASLM 20. An observer 

50 1 0 is infrared illuminated by an illumination system com- 
prising a left illumination 12L and a right illumination 
12R, alternately illuminating the left and right half side 
face of the observer, with an alternation frequency of for 
example 1000 Hz. 

55 [0103] Each lens element of the microlens array 14' 
and a region of the OASLM 20' layer operates as a 
screen element, similar to that of the above described 
prototype ambodiment. In this arrangement, the 
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OASLM 20 is constructed with ferroelectric liquid crys- 
tals and a thin film photosensor layer, and is operated 
in an integrating, image subtracting mode, where posi- 
tive and negative update patterns are integrated over 
time. Further, the ferroelectric liquid crystals posesses 
a true bistable nature, providing a desired memory effect 
with a "hold"-state, in which the OASLM 20 is insensitive 
to light and the modulation pattern is maintained. 
[0104] The operation cycle of the OASLM and the il- 
lumination system are synchronized to one another, and 
they are also synchronized with the videprojector pair's 
blanking intervals. The operation cycle is illustrated in 
fig. 14. 

[0105] Wheneverthevideprojectors areintheirblank- 
ing interval, the OASLM update cycle begins, using re- 
flections from the observer's alternatingly left-right infra- 
red illuminated face. When the illumination system illu- 
minates the observer's left half face, the OASLM per- 
forms a positive update, and when the illumination sys- 
tem illuminates the observer's right half face, the 
OASLM performs a negative update, and vice-versa. 
This operation mode improves control of the threshold- 
ing function and reduces interference from light from 
other sources than the illumination system, such as am- 
bient room light, because these will normally be relative- 
ly constant, and therefore cancelled out by the alternat- 
ing positive and negative updates. Further, dark-current 
noise in the diode structure will be reduced due to aver- 
aging with this operating cycle. 
[0106] It is to be noted, though, that even if any con- 
stant lights will be cancelled out, strong constant lights 
may affect the desired sensitivity of the OASLM towards 
the alternated infrared light, because the OASLM is not 
a linear device, and may be driven to it's less sensitive 
operating condition. Therefore, it is still desirable to re- 
duce strong constant lights, an obvious source being the 
projector pair. Therefore, when the video projectors are 
not in their blanking interval, the OASLM is put into a 
"hold"-mode, maintaining it's modulation pattern until 
the blanking interval and the next update cycle. 
[0107] Fig. 9 shows an example of a standard 
OASLM. 96 is a ferroelectric liquid crystal layer, in which 
the molecules respond to the polarity of an imposed 
electric field, such that a positive polarity causes a tran- 
sition to a state where the molecules rotates the polari- 
sational direction of transmitted light approximately 90 
degress, and a negative polarity causes a transition to 
a state where the molecules rotates the polarisational 
direction of transmitted light approximately 0 degress. 
The polarizer 98 transmits only light of horisontal direc- 
tion. Therefore, when a positive voltage is supplied 
across a region of the liquid crystal layer, a transition of 
the molecules in the region to a V-state occurs, in which 
state only vertically polarized light is transmitted. A volt- 
age of negative polarisation will similarly initiate a tran- 
sition towards a H-state, in which state the region in 
question is only transparent to horisontally polarized 
light. 



[0108] 90A and 90B are bearing glassplates, each 
coated on the inside with a transparent electrode layer 
of conduction oxide, 92A and 92B, respectively. 94 is an 
amorphous silicon photosensitive layer, comphsing a 

5 number of heterojunctions forming a back-to-back pho- 
todiode structure. This arrangement has been shown to 
provide high sensitivity and fast response (Robinson, 
Sharp Labs) and requires only a thin layer of a few mi- 
crometers, which is desirable to achieve good spatial 

10 resolution. Further it can be produced with low temper- 
ature grown amorphous silicon, enabling manufacturing 
in large areas, as is known from e.g. solar cells. Reso- 
lutions of OASLM's with unifomn photosensitive layers 
have been reported of up to at least 30 line pairs per 

15 millimeter, vide e.g. "Hydrogenated Amorphous Silicon 
Photosensor for Optically Addressed Spatial Light Mou- 
lators", IEEE Transactions on Electron Devices Vol. 36, 
No. 1 2, December 1 989; 'Thin Film Photosensor Design 
and Fabrication Issues for Liquid Crystal Spatial Light 

20 Modulators", SPIE Vol, 2022 Photodetectors and Power 
Meters, 1993, section 4.4. The resolution is primarily 
limited by charge diffusion in the photosensitive layer 
and being a trade-off between response time, sensitivity 
and resolution. In this respect, it is an advantage that 

25 fast response times may not be needed, since any 
movement of the observer's will be relatively slow. 
[0109] 95 is a dielectric reflector. When an adequate 
voltage is supplied to the electrodes, the impedance 
match between the photosensitive layer and the liquid 

30 crystals control the state of the liquid crystal. Therefore, 
in areas in which the photosensor is sufficiently illumi- 
nated, the photosensor exhibitis a high impedance and 
most of the voltage drop occurs across the liquid crystal, 
causing a transition to occur, whereas in dark areas, 

35 most of the voltage drop occurs across the photosensor 
and only a small electric field is present across the liquid 
crystal, which electric field is not sufficient to initiate a 
transition. Hence, charge patterns, or "domains", in the 
physically unpatterned OASLM control the modulation 

40 of transmitted light. Construction of thin films based 
OASLMs have been described in among others "Trade- 
offs in the Design and Operation of Optically Addressed 
Spatial Light Modulators", SPIE Vol. 1562 Devices for 
Optical Processing, 1991; and US Patents 4,655,554 

45 and 3,824,002. Reference is made to the above US Pat- 
ents which are further hereby incorporated in the 
present specification by reference. 
[0110] Integrating behaviour of ferroelectric liquid 
crystals has been demonstrated in among others: "Inte- 

50 grating Mode for an Optically Addressed Spatial Light 
Modulator", Applied Optics Vol. 32 No. 17, 10. June 
1993, Several short pulses of positive voltage, each of 
a duration insufficent for a transition to occur, is integrat- 
ed, so together they are capable of causing a transition. 

55 Short negative pulses inhibit this transition, or, if the 
transition has already ocurred, they will tend to initiate 
a transition to the other state. In short, an image sub- 
tracting operation is achieved, in which the time-inte- 
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grated sum of positive and negative pulses controls tlie 
state of the liquid crystal molecules. 
[0111] The OASLM used in the present arrangement 
is illustrated in Fig. 10, and is a slightly altered version 
of the standard image subtracting OASLM , in which the s 
dielectric reflector stack, as shown in Fig. 9 is omitted 
and a diffusing layer 100 is added. 
[0112] An integrating image subtracting behaviour 
may also be achieved using nematic liquid crystals, 
when operated with a high frequence square wave volt- io 
age. The crystals respond not to the polarity but to the 
rms value of a supplied voltage, but integrating and sub- 
tracting operation may be possible because of the build 
up time and discharge times of charges across the layer, 
defined by the OASLM's RC time constant due to it's is 
internal capacitance and resistance. Likewise, a mem- 
ory effect utilizing this time constant was utilized in the 
above described prototype embodiment. 
[0113] The thresholding function of the OASLM and 
the illumination intensity may be adjusted. In order to 20 
achieve the desired binary pattern in the OASLM. 
Thresholding in the OASLM may be controlled by the 
magnitude, frequency and DC offset of the square wave 
operating voltage. Another approach, which allows for 
very precise control, is to include a third terminal in the 25 
OASLM, thereby allowing the construction of a voltage 
divider when further including an external resistor, which 
may be controlled very accurately. The third terminal 
may be a structured metal conductor, for example a grid 
or hole mask, vide e.g. "Dynamic Thresholding with the 30 
Three-terminal Optically Addressed Spatial Light Mod- 
ulator", Matehal Research Society Symposium Pro- 
ceedings Vol. 258, 1992. Such an arrangement may be 
advantagously combined with the above mentioned 
shading pattern. Still another approach may be to in- 35 
elude discrete thin film structures exhibiting electrical 
characteristics, for example a non-linear diode structure 
or even an active structure, like a thin film transistor. 
[0114] Constantand exactthickness of the liquid crys- 
tal layer is important to achieve the desired rotation of 40 
the polarisational direction of transmitted light. Normally, 
this thickness is controlled by edge spacers. According 
to the present invention, the area of the OASLM used 
by each lens element is a function of the desired maxi- 
mum viewing angle and the refractive characteristics of 45 
the microlens array layer 14', which can be designed, 
so as to allow some unused area inbetween the used 
areas, giving room for a spacing structure within the lay- 
er of liquid crystals itself, thereby enabling good control 
of layer thickness even in extremely large constructions, so 
The spacing structure may be a non-conducting grid or 
a thin polymer film with punched or otherwise produced 
holes, such as illustrated in fig. 11. 90A is the bearing 
glassplate coated with a transparent electrode layer 
92A, 11 0 is the polymer film with holes, and 96 are the 55 
liquid crystals in the holes, forming the active regions of 
the OASLM, which must be aligned with the lens ele- 
ments of the microlens array layer. The capillary forces 



are sufficient for keeping the construction together. 
[0115] Additionally or alternatively, a similar but pref- 
erably thicker spacing structure may be inserted be- 
tween the OASLM and the refractive optical system. 
This structure may also provide the desired effect of 
blocking light between screen elements, eliminating the 
problem of an observer, when moving outside the de- 
signed viewing angle, seeing light through a lens ele- 
ment of one screen element from the region of the 
OASLM layer of the neighbouring screen element, This 
will not in itslef lead to an incorrect perceived image, like 
the effect does in traditional displays, but it does incur 
a little risk of multiple different paths for infrared reflec- 
tions from different observers to incide on the same 
spot, thereby resulting in an undesired modulation. 
[0116] The use of a transparent, uniform photosensi- 
tive layer will introduce some absorption of the read- 
light, which may not be of uniform spectral distribution, 
and hence require a hue correction in the form of optical 
or electronic filters or adjustment of display or projection 
equipment. In order notto maximize read-light transmis- 
sion, the thickness of the photosensitive layer may be 
reduced, thereby however also reducing the sensitivity. 
A tradeoff between infrared sensitivity and light gain 
therefore exists, which emphasizes the need to employ 
othertechniques for improving signal-to-noise ratio, like 
e.g. the above mentioned image subtraction technique, 
the above described blanking interval synchronisation 
technique and the use of a shading layer. 
[0117] In Fig. 7., a second alternative embodiment of 
the autostereoscopic display element according to the 
present invention is shown. This embodiment is similar 
in its operation of the OASLM 20' to the above described 
arrangement, but a flat-panel display 2', displaying a 
spatially multiplexed stereoscopic image pair is used in- 
stead of a projector pair, and further an adaptive illumi- 
nation system is included. 

[0118] A polarising layer 72 comprising a striped pat- 
tern of alternate polarisation direction is located in front 
of the display 2" so that alternate rows of pixels are cov- 
ered by strips of alternate polarisational direction. Con- 
sequently, even number row pixels emit horisontally po- 
larised light towards the screen and odd number row pix- 
els emitvertically polarised light towards the screen. Fig. 
8 shows such a layer having strips 80H and SOV of hori- 
sontal and vertical polarising direction. A different pat- 
tern than a stripe pattern may be used, for example a 
checkerboard pattern, which will provide equal vertical 
and horisontal resolution of the images of the stereo- 
scopic image pair, whereas the horisontal stripe pattern 
will provide full horisontal but half vertical resolution of 
each of the images, as compared to the display display- 
ing a monoscopic, non-multiplexed image. However, the 
stripe pattern is more compatible easily with existing 
methods of coding stereoscopic images and may be 
easier to manufacture. 

[0119] An alternative to the patterned polarizer is a 
structured OASLM having its structure matching and 
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aligned with tlie spatial multiplexing pixel pattern of the 
display. For example, the OASLM may comprise striped 
electrodes on one or both glass plates, so that alternat- 
ing rows of electrodes aligned with rows of lenss In the 
micro lens layer may be supplied with the operating volt- 
age square wave having alternating ly reversed and non- 
reversed voltage polarisation, Using a structured 
OASLM aligned with a pattern of pixels of the display, 
enables the use of other types of OASLM's based on 
other modulation layers than liquid crystals, because In 
this case the domains in the modulating layer do not 
have to be selectively transparent to light of different po- 
larisational directions, but may simply vary the transmis- 
sion rate of transmitted light, polarised or unpolarised. 
Such a structured OASLM's modulation layer may in- 
clude the use of the Franz-Keldysh effect or the Quan- 
tum confined Stark effect and may be dispersed within 
the photosensitive layer, so that one layer Is both sens- 
ing and modulating light. Reference Is made to US Pat- 
ent 6,025,950, which is hereby incorporated in the 
present specification by reference. 
[01 20] The illumination system is shown in greater de- 
tails in fig. 12 and comprises an infrared camera 40', an 
Image processing system 127 and an infrared projection 
system. The infrared projection system comprises an 
optical element 74, a monochrome liquid crystal spatial 
light modulator 1 22 and an illumination source alternate- 
ly emitting light with horisontal andvertlcal polarlsatlonal 
direction at an alternation frequence of about 1000 Hz 
and synchronized with the operating cycle of the 
OASLM. 

[0121] The illumination source comprises an array of 
infrared light emitting diodes 126, located outside of the 
focal plane of the lens. The LED array Is constructed so, 
that even or odd rows are illuminated selectively. This 
may be achieved by wiring the LED's to the same volt- 
age supply leads, but In alternate directions, so that 
when a positive voltage Is applied to the LED array, even 
rows are illuminated, and when a negative voltage is ap- 
plied, odd rows are illuminated. A polarlser 1 24 is locat- 
ed In front of the LED array, with strips of alternating hori- 
sontal and vertical polarlsatlonal directions similar to 
that of fig 8, and aligned with the rows of LEDs, so that 
when even rows are illuminated, horisontal ly polarized 
light Is emitted, and when odd rows are illuminated, ver- 
tically polarized light is emitted. 
[0122] The camera contlnously captures infrared im- 
ages of the observers, for example at a frame rate of 60 
frames per second, and feed these to the image 
processing system. The image processing system 
tracks the individual observer, and contlnously synthe- 
sizes binary images of left half face Image of the Indi- 
vidual observer and output these to the spatial light mod- 
ulator. Image processing based observer tracking is for 
example demonstrated In US Patent 6,069,649 to which 
reference is made and which is hereby Incorporated in 
the present specification by reference. As the LED array 
emits light of alternating polarlsatlonal direction, pat- 



terns on the spatial light modulator fonning normal and 
reversed images of these synthesized binary left half 
side face images wll alternate and be projected through 
the lens 74 towards the Individual observer. 

5 [0123] Hence, the Individual observerwill be Illuminat- 
ed by these alternating normal and reversed binary half 
face images, and when the camera and projector are 
propehy aligned and their optical characteristics are ap- 
propriately adjusted by one another, the projection sys- 

10 tern will alternately illuminate the left half face of the In- 
dividual observer and illuminate everything except the 
left half face, Including the right half face. Consequently, 
the desired alternating left half face, right half face infra- 
red Illumination is achieved, and synchronized with the 

15 OASLM, the operating cycle illustrated in fig. 14, being 
identical to that of the above described first alternative 
embodiment. 

[0124] The image processing system needs appropri- 
ate illuminated images of the individual observer, forex- 

20 ample uniformly frontally illuminated. Oneway of obtain- 
ing this is to use a shutter speed in the camera long 
enough to cover at least two succeeding alternate nor- 
mal and reversed images, for example 1/500 second, 
thereby performing a temporal integration of the re- 

25 versed images, resulting in a uniformly frontal illuminat- 
ed Image, assuming that the individual observer Is es- 
sentially not moving during the shutter time. However, 
In this embodiment, the shutter speed Is selected to be 
equal to or less than one half period of the alternation 

30 cycle, so that only a normal or reversed image is cap- 
tured at a time. The shutter operation is then synchro- 
nized with the illuminations systems alternation phase, 
so that separate succeeding images of normal and re- 
versed Illumination Is obtained. A difference Image is the 

35 calculated, each pixel value being given by the numer- 
ical difterence between corresponding pixel values of 
the two captured reversely illuminated images. 
[0125] This technique will likewise produce a uniform- 
ly frontally illuminated image, again assuming that the 

40 individual observer is not moving between alternation 
cycles. This technique has the advantage of cancelling 
out any light not originating from the illumination system, 
ensuring that the images are always captured in a well 
defined constant infrared Illumination, which Is an ad- 

45 vantage for the Image processing. 

[0126] Further, the separate captured images of re- 
versed illumination, may provide data for an automatic 
correlation of captured and projected Images, enabling 
automatic compensation of geometric errors and inac- 

50 curacies due to parallax difterence, alignment of camera 
and projector, difference In optical elements etc. Atable 
of correlation parameters may be stored by the image 
processing system. 

[0127] Another way of reducing parallax and allgn- 
55 ment problems Is to let the camera capture an Image 
projected through the same lens as the projection sys- 
tem uses. This technique is illustrated in fig. 13. A half 
mirror 132 projects the Images of the alternatingly lllu- 
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minated individual observer onto a projection plate 130, 
and the infrared camera 40' is capturing an image of the 

projection plate. 

[0128] With this availabiiity of images always cap- 
tured in a well defined constant infrared illumination, it 
is further possible to maintain a reference background 
image of the interiour in front of the display. The back- 
ground image assists the image processing system in 
detecting and tracking the individual observer. The 
background image may be subtracted from the captured 
images, thereby cancelling reflections from fixed objects 
in the room such as walls, floor, furniture, etc., effectively 
isolating moving objects (and their shadows). This prin- 
ciple is well known for example in intruder detection sys- 
tems. 

[0129] The background image may be obtained by 

manual assistance, for example a pushbutton function 
activated when installing the screen and display, acti- 
vated by the operator when the viewing area in front of 
the display is empty. Alternatively, it may be maintained 
automatically by the illumination system by median fil- 
tering images captured continously over long intervals, 
for example one image per hour. During such long in- 
tervals, the observers are assumed to be moving back 
and forth, thereby being cancelled out by the difference 
image function, and only the long time constant reflec- 
tions such as from walls, furniture etc. will remain, pro- 
viding the background reference image for the observer 
tracking function. Reference is made to US Patent 
4,772,943 which US Patent is further hereby incorporat- 
ed in the present specification by reference. 
[0130] In a third alternative embodiment, similar to the 
above described second alternative embodiment, but 
capable of displaying temporarily multiplexed, or time 
division, steresocpic images, the patterned polarizer is 
replaced by a uniform polarizer of uniform polansing di- 
rection, and a large liquid crystal cell is located in front 
of it. The liquid crystal cell is capable of rotating the po- 
larisational direction either approximately 0 degrees or 
approximately 90 degrees, and is synchronized with the 
alternation frequency of the displayed time division 
based stereoscopic images. 

[0131] In a fourth alternative embodiment, a front pro- 
jection screen is constructed, capableof displaying tem- 
porarily multiplexed, ortime division based, stereoscop- 
ic images from a pair of front projectors. The arrange- 
ment resembles that of the above described third alter- 
native embodiment, but the display is replaced by a re- 
flector. A uniform polarizer and a liquid crystall cell are 
still located in front of it. In this arrangement, the liquid 
crystal cell is synchronized with the projector pairs' al- 
ternation frequency. The reflector must be spaced apart 
from the lens array layer, so that the projected spot of 
light emitted from the front projection system onto the 
reflector is not in focus, but is enlarged to approximately 
the same size as the lens elements of the lens array 
layer, to allow reflection of projection system light in any 
angle within the desired viewing angle. An infrared 



source synchronized with the operating cycle of the illu- 
mination system and the OASLM are located close to 

the projectors, to make the OASLM transparent to light 
in the direction of the projectors, so that projection light 
5 entering the lens is transmitted unobstructed to the re- 
flector. 

[01 32] In a fifth alternative embodiment, the display is 
a color or monochrome electrically addressed LCD dis- 
play, and the OASLM is integrated into the LCD display, 

10 by the inclusion of an extra photosensitive layer into the 
LCD. The impedance of the photosensitive layer masks 
out areas of each electrically addressed pixel, so that 
the OASLM works with the same liquid crystal layer as 
the display, hence only one liquid crystal layer is need- 

15 ed. The photosensitive layer may be transparent and lo- 
cated in front of the liquid crystal layer or it may be 
opaque, i.e. having a high absorption rate, thereby al- 
lowing for high sensitivity, if located behind the liquid 
crystal layer. In the latter an^angement, a layer reflecting 

20 visible light but transmitting infrared light may be includ- 
ed inbetween the photosensitive and the liquid crystal 
layer. If a color LCD with dyes is used in the latter ar- 
rangement, dyes must be transparent to infrared light. 
[0133] Although the present invention has been de- 

25 scribed above with reference to a number of presently 
prefered embodiments and also certain alternatives of 
the presently prefered embodiment of autostereoscopic 
display element or arrangement/system according to 
the present invention, the present invention is by no 

30 means limited to the above described embodiments or 
alternatives. The present invention is ratherto be under- 
stood in accordance with the appending claims and the 
invention is further to be construed including modifica- 
tions, alternatives etc. of the technique defined in the 

35 appending claims which modifications or amendments 
are to be considered obvious to a person having ordi- 
nary skill in the art. 

40 Claims 

1. An autostereoscopic display system, comprising: 

i) image generating means for the generation 
45 of a pair of orthogonally polarised images, the 

one image being vertically orientated with re- 
spect to its polarisation and the other image be- 
ing horisontally orientated with respect to its po- 
larisation, said images being transmitted from 

50 said image generating means along respective 

optical paths towards one or more observers for 
the illumination of at least a left hand part and 
a right hand part including the left eye and the 
right eye, respectively, of the head or heads of 

55 said one or more observer, 

ii) an optically addressed spatial light modulator 
(OASLM) including a plurality of light transmis- 
sion elements, each being individualy optically 
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addressable, and each having an optical input 
and an optical output and being shiftable be- 
tween a V-state and a H-state in which V-state 4. 
the transmission of vertically polarised light 
from said optical input to said optical output is s 
allowed and thetransmission of horisontally po- 
larised light from said input to said output is in- 
hibited or blocked, and in which H-state the 
transmission of horisontally polarised light from 
said optical input to said optical output is al- io 5. 
lowed and the transmission of vertically polar- 
ised light from said optical input to said optical 
output is inhibited or blocked, each of said light 
transmission elements having an optical sen- 
sor for the shifting between said V-and H -states is 
through exposure to light or, preferably, infrared 
radiation (IR), said OASLM being positioned in 
said optical paths from said image generating 
means to said one or more observers, 
III) an infrared illumination system for illuminat- 20 
ing said one or more observers for illumination 
of at least the left hand part or the right hand 
part of the head of each of said one or more 
observers and in doing so, exposing a first part 6. 
of said optical sensors of said plurality of light 25 
transmission elements of said OASLM to infra- 
red radiation reflected from the left hand part or 
the right hand part of the head of each of said 
one or more observers, said optical sensors of 
said first part shifting their respective light 30 
transmission elements into allowing transmis- 
sion of a first image of said pair of orthogonally 
polarised images and inhibiting or blocking for 7. 
the transmission of the other or second image 
of said pair of orthogonal polarised images and 35 
said optical sensors not belonging to said first 
part shifting their respective light transmission 
elements into allowing transmission of the other 
or second image of said pair of orthogonally po- 
larised images and inhibiting or blocking forthe 40 
transmission of the first image of said pair of 8. 
orthogonal polarised images through said re- 
maining light transmission elements, and 
iv) a refractive optical system, including at least 
one refractive optical element position in front 45 
of said OASLM between said OASLM and said 
one or more observers for establishing said op- 
tical parts. 9. 

2. The autostereoscopic display system according to 50 
claim 1 , said at least one refractive optical element 

including a lens system, inlcuding at least one cir- 
cular or cylindncal lens and/or including a multitude 
of refractive optical elements. 

55 10. 

3. The autostereoscopic display system according to 
any of the claims 1 or 2 , said OASLM being a struc- 
ture including a plurality of discrete OASLM ele- 



ments or alternatively being a continuous structure. 

The autostereoscopic display system according to 
any of the claims 1 -3, said image generating means 
being constituted by a CRT (cathode ray tube)- an 
LCD (liquid crystal display)- a DLP (digital light 
processing) projector, a film or slide projector or al- 
ternatively a CRT-, an LCD- or plasma display. 

The autostereoscopic display system according to 
any of the claims 1 -4, said image generating means 
being controlled by a clock generator generating a 
blanking period in which said image generating 
means be turned off, said optical sensors of said 
OASLM being controlled by said clock and prefer- 
ably being enabled during said blanking period and 
being disabled outside said blanking period, so that 
no shifting of the state of said light transmission el- 
ements may occur outside said blanking period, 
and said infrared illumination system preferably be- 
ing controlled by said clock and being turned on dur- 
ing said blanking period. 

The autostereoscopic display system according to 
any of the claims 1-6, said system comprising two 
infrared illumination systems for illuminating said 
one or more observers from both sides for illuminat- 
ing a respective head half part of each of said one 
or more observers and in doing so, addressing spe- 
cific optical sensors of said plurality of light trans- 
mission elements of said OASLM. 

The autostereoscopic display system according to 

any of the claims 1 -6, said image generating means 
generating a spatially modulated stereoscopic im- 
age pair and including a patterned polanser with a 
pattern of areas of essential orthogonal polarisation 
direction located between the image generating 
means and the OASLM. 

The autostereoscopic display system according to 
any of the claims 1-7, further including a polariser 
having a striped pattern, a checker board pattern or 
any other relevant pattern, or alternatively including 
striped or patterned electrodes integrated in said 
OASLM. 

The autostereoscopic display system according to 
claim 6 and any of the claims 7-8 refering to claim 
6, said two infrared elimination system being pulsed 
or temporarily modulated with different phases or 
frequency or alternatively having different peak 
wavelengths. 

The autostereoscopic display system according to 
any of the claims 1 -9 further including interference 
reducing means for reducing the interfering effect 
on said optical sensors of said light transmission el- 
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ements from sources different from said infrared 
elimination system. 

11. The autostereoscopic display system according to 
any of the claims 1-10 and comprising any of the 
features of the display system as herein before de- 
scribed and illustrated in the accompanying draw- 
ings. 
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